This Page Is Inserted by IFW Operations 
and is not a part of the Official Record 



BEST AVAILABLE IMAGES 

Defective images within this document are accurate representation of 
The original documents submitted by the applicant. 

Defects in the images may include (but are not limited to): 

• BLACK BORDERS 

• TEXT CUT OFF AT TOP, BOTTOM OR SIDES 

• FADED TEXT 

• ILLEGIBLE TEXT 

• SKEWED/SLANTED IMAGES 

• COLORED PHOTOS 

• BLACK OR VERY BLACK AND WHITE DARK PHOTOS 

• GRAY SCALE DOCUMENTS 



IMAGES ARE BEST AVAILABLE COPY. 



As rescanning documents will not correct images, 
please do not report the images to the 
Image Problem Mailbox. 
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RECEIVE IMAGES OVER NETWORK 
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DETERMINE POSITION OF SEGMENT CORRESPONDING TO EACH IMAGE RELATIVE TO 
POSTION OF SEGMENTS CORRESPONDING TO OTHER IMAGES 



I 
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CORRECT PERSPECTIVE DISTORTION IN ALL RELATIVE TO CENTRAL IMAGE 
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SET PIXELS OF ALL IMAGES VISIBLE EVERYWHERE 



I 
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SET CURRENT IMAGE TO FIRST IMAGE 



I 



SET CURRENT IMAGE TO NEXT AFTER CURRENT IMAGE AND REFERENCE IMAGE TO FIRST 
210 IMAGE 



212 



DETERMINE OUTLINE OF PANORAMIC IMAGE FORMED BY ALLIGNING THE CURRENT AND 
REFERENCE IMAGES BASED ON THE RELATIVE POSITION OF THE SEGMENT 
CORRESPONDING TO THE CURRENT IMAGE 



p214 



DETERMINE LINE DIVIDING PANORAMIC OUTLINE (I.E., LONGEST LINE JOINING POINTS 
WHFRF RHRnFRS OF PTTRRFNT TMAGF ANT> RFFFRFNrF TMAP.F TNTFR55FP*n 
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DIVIDE PANORAMIC OUTLINE INTO TWO SECTIONS BASED ON LINE 



;s 218 



DETERMINE WHICH OF THE TWO SECTIONS HAS LESS OF THE CURRENT IMAGE THAT IS NOT 
OVERLAPPED BY THE REFERENCE OUTLINE 
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SET CURRENT IMAGE TO NOT BE INVISIBLE IN THE DETERMINED SECTION 




YES 
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T NO 



DETERMINE MASKING VALUE FOR EACH PIXEL OF CURRENT IMAGE BASED ON VISIBLE 
ARF A OF TMAfrF AMD PROVTX^TTV TO nrvmiMH I INFS 
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OVERLAP IMAGES BASED ON MASKING VALUES TO CREATE A PANORAMIC IMAGE 



Fig. 3 



( DONE ) " 
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SET REFERENCE TO 
NEXT IMAGE AFTER 
REFERENCE IMAGE 
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CREATE EMP' 
STORING I MAGI 



SITIONED LISr STRUCTURE FOR 
IOS RELATIVE POSITON IS KNOWN 



C 



DONE 
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ADD UNPOSITIONED IMAGE TO POSITIONED LIST 



CREATE EMPTY "OVERLAP LIST" FOR STORING IMAGES 
IN POSITIONED LIST THAT OVERLAP THE UNPOSITIONED 
IMAGE 



7«v 



7^ 



SET: 

BEST CONFIDENCE =0 
BEST.CONFIDENCEJMAGE = NO.MATCH 
CURRENT IMAGE = FIRST IMAGE IN POSITIONED LIST 



7<o 



7^ 



» DETERMINE OFFSET OF 
UNPOSITIONED IMAUb RELATIVE TO CURRENT IMAGE 
AND A CONFIDENCE VALUE FOR THE OFFSET 




ADD CURRENT IMAGE, THE OFFSET, AND THE 
CONFIDENCE VALUE TO THE OVERLAP LIST 




SET: 

BEST.CONFIDENCE = CONFIDENCE VALUE 
BEST CONFIDENCE IMAGE=CURRENT IMAGE 




SET REFERENCE IMAGE TO FIRST IMAGE IN OVERLAP 
LIST 



GO TO 750 (FIG 7B) 
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SET CURRENT IMAGE TO NEXT IMAGE IN 
POSITIONED LIST 



Fig. £A 



^FROM 773 (FIG 7A) 
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CURRENT IMAGE- NEXT IMAGE AFTER REFERENCE IMAGE IN OVERLAP 

LIST 



YES 



_ CHECK IF 

ADJACENT LISTS INDICATE THAT CURRENT IMAGE IS 
EJECTED TO REFERENCE IK 



NO 



TRANSLATE CURRENT IMAGE AND ALL IMAGES CONNECTED TO IT 
RELATIVE TO THE REFERENCE IMAGE BASED ON THE OFFSETS OF 
THE REFERENCE AND CURRENT IMAGE TO THE UNPOSITIONED IMAGE 



APPEND T HE UNPOSI TI ONED I MAGE AND THE A/E OF THE OFFSET OF | 
THE CURRENT IMAGE RELATIVE TO THE UNPOSITIONED IMAGE TO THE 
ADJACENT LIST OF THE CURRENT IMAGE 
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SET 

CURRENT = NEXT IMAGE 
AFTER CURRENT IMAGE 
IN OVERLAP LIST 



APPEND THE UNPOSITIONED IMAGE AND THE -VE OF THE OFFSET OF 
THE REFERENCE IMAGE RELATIVE TO THE UNPOSITIONED IMAGE TO 
THE ADJACENT LIST OF THE REFERENCE IMAGE 



1^ 



2 SET 
a REFERENCE = NEXT 
Tj IMAGE AFTER 
PREFERENCE IMAGE IN 
d OVERLAP LIST 



YES 




7b« 



TRANSLATE UNPOSITIONED IMAGE RELATIVE 
BEST CONFIDENCE JMAGE BASED ON THE OFFSET OF THE 
BEST_CONFIDENCE IMAGE 



APPEND IMAGES IN OVERLAP LIST AMD THEIR OFFSETS TO (rib 
ADJACENT LIST OF THE UNPOSITIONED IMAGE 



ADD UNPOSITIONED IMAGE TO THE POSITIONED LIST 
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IIS 



GOTO 70y (FIG7A) 



Fig. 56 



DETERMINE CENTERMOSTUKGE BASED ON RELATIVE 
POSITIONS 



CREATE UST OF CORRECTED IMAGES THAT INCLUDES ONLY 
THE CENTERMOST IMAGE 



CREATE LIST OF UNCORRECTED IMAGES THAT INCLUDES 
EVERY IMAGE EXCEPT THE CENTERMOST IMAGE 



INITIALIZE BY SETTING: 
MAX OVERLAP JKREA=0 
SELECTED WARPED IMAGE«UNDEFINED 
SELECTED UNWARPED IMAGE=UNDEFINED 



SET: 

CURRENT WARPED-FIRST IN IMAGE IN CORRECTED LIST 
CURRENT UNWARPEDsFIRST IMAGE IN UNCORRECTED LIST 
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COMPUTE OVERLAP AREA BETWEEN CURRENT J/VARPED AND 
CURRENT UNWARPED 




CHANGE SELECTED IMAGES BY SETTING: 
MAX OVERLAP AREA»OVERLAP AREA 
SELECTED WARPED IMAGE°CURRENT WARPED 
SELECTED UNWARPED IMAGE*CURRENT_UNWARPED 




SET CURRENT WARPED = NEXT IMAGE IN LIST OF 
CORRECTED IMAGES 



SET: 

CURRENT.UNWARPED = NEXT IMAGE IN UST OF 
UNCORRECTED IMAGES 
CURRENT WARPED = FIRST IMAGE IN LIST OF 
CORRECTED IMAGES 



DONE 



CORRECT THE PERSEPECTIVE OF £&L€Cl€ £JJNWARPED 
RELATIVE TO StUKfff&WARPED BASED ON THEIR RELATIVE 
' POSTIONS 



MOVE CURRENT UNWARPED IMAGE FROM LIST OF 
UNCORRECTED IMAGES TO LIST OF CORRECTED IMAGES 
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